Optimized memory model for hadoop map reduce framework
نویسندگان
چکیده
منابع مشابه
Optimized-Memory Map-Reduce Algorithm for Mobile Learning
The increasing accessibility of mobile technologies and devices, such as smartphones and tablet PCs, has made mobile learning (m-learning) a critical feature of modern didactics. Mobile learning is among the many computerized activities that can be performed using mobile devices. As the volume of accessible important information on university websites continues to increase, students may face di...
متن کاملBig Data Processing with Hadoop Map-reduce
The amount of data in our world has been exploding, and analyzing large data sets—so-called big data—will become a key basis of competition, underpinning new waves of productivity growth, innovation, and consumer surplus. The increasing volume and detail of information captured by enterprises, the rise of multimedia, social media, and the Internet of Things will fuel exponential growth in data ...
متن کاملImplementation and Analysis of Join Algorithms to handle skew for the Hadoop Map/Reduce Framework
he Map/Reduce framework-a parallel processing paradigm-is widely being used for large scale distributed data processing. Map/Reduce can perform typical relational database operations like selection, aggregation, and projection etc. However, binary relational operators like join, cartesian product, and set operations are difficult to implement with Map/Reduce. Map/Reduce can process homogeneous ...
متن کاملCloud Hadoop Map Reduce For Remote Sensing Image Analysis
Image processing algorithms related to remote sensing have been tested and utilized on the Hadoop MapReduce parallel platform by using an experimental 112-core high-performance cloud computing system that is situated in the Environmental Studies Center at the University of Qatar. Although there has been considerable research utilizing the Hadoop platform for image processing rather than for its...
متن کاملHadoop Memory Usage Model
Hadoop MapReduce is a powerful open-source framework towards big data processing. For ordinary users, it is not hard to write MapReduce programs but hard to specify memory-related configurations. To help users analyze, predict and optimize job’s memory consumption, this technical report presents a fine-grained memory usage model. The proposed model reveals the relationship among memory usage, d...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Electrical and Computer Engineering (IJECE)
سال: 2019
ISSN: 2722-2578,2088-8708
DOI: 10.11591/ijece.v9i5.pp4396-4407